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MEDICAL DEMONSTRATION 
Background of the Invention 

The present invention relates to a method and apparatus for allowing medical practitioners 
S to demonstrate the effects of a medical condition, or a treatment to an individual. 

Description of the Prior Art 

The reference to any prior art in this specification is not, and should not be taken as, an 
acknowledgement or any form of suggestion that the prior art forms part of the common 
1 0 general knowledge in Australia. 

WOOl/08076 describes a system that allows medical practitioners to demonstrate the 
effects of medical conditions and treatments to individuals. This is achieved by providing 
images or animations of the medical conditions and treatments. The images and 
15 animations are determined using wire firame models, and are created and/or checked by 
medically qualified personnel, to thereby ensure anatonGUcal correctness. 

However, whilst this system helps medical practitioner explain the effects of the medical 
condition or treatment, the functionality provided by this system is limited, and in 
20 particular, will only allow the medical practitioner to demonstrate conditions passively. 

Summary of the Present Invention 

In a first broad form the present invention provides a method of allowing medical 
practitioners to demonstrate the effects of a medical condition or a treatment to an 
25 individual using a processing system, the method including causing the processing system 
to: 

a) Obtain image data in accordance with an input command received from the medical 
practitioner, the image data defining one or more images; 

b) Present the one or more of the images on a display; and, . 

30 c) Present aimotations on the display in response to one or more input conmoiands. 

The image data can define one or more image sequences, in which case, the method 
typically includes causing the processing system to: 
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a) Present one or more of the images in the image sequence in response to an input 
contmiands; 

b) Select a respective one of the images in response to an input command; and, 

c) Present image annotations for the selected image. 

5 

The annotations generally include at least one of: 

a) Text annotations; and, 

b) Drawings annotations. 

10 In this case, it will be appreciated that the drawing annotations may take a variety of fomis, 
Willi the aimotations also optionally being provided in a variety of colours. Additionally, 
other annotations, such as graphics, or the like may be used. 

The method typically includes causing tiie processing system to superimpose the 
1 5 aimotations on the respective image. 

The method also typically includes causing the processing system to store the annotations 
in a store in accordance with an input command. This allows the stored annotations to 
form part of the individual's medical recoids. 

20 

In this case, the store can be coupled to one or more processing systems by a 
commimications network. This allows selected medical practitioners to access the patients 
medical records via communications network using a respective one of the processing 
systems. 

25 

The method can include causing the processing system to store the annotations together 
witih at least an indication of the respective image. 

The method also usually includes causing the processing system to store the aimotation as 
30 a respective image. However, the annotations may alternatively be stored in different 
forms. 
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The method generally includes causing the processing system to store additional 
information together with the annotations, the additional information including at least one 
of: 

a) The patient identity; 
5 b) The medical practitioner identity; 

c) A diagnosis; and, 

d) A time and/or date indication representative of when the annotations were created. 



The processing system can be coupled to one or more end stations via a conmiunications 
10 network. In titiis case, the method typically includes causing the processing system to: 

a) Receive input commands from the end stations via the communications network; 
and, 

b) Present the image(s) and the annotations to the medical practitioner using the end 
station. 

15 

In a second broad form the present invention provides a processing system for allowing 
medical practitioners to demonstrate the effects of a medical condition, or a treatment to an 
individual, the processing system including: 

a) A store for storing image data, the image data defining one or more images; 
20 b) An input for receiving input commands from the medical practitioner; 

c) A display for displaying the images; and, 

d) A processor, the processor being adapted to: 

i) Present one or more of the images on the display in response to an input 
command; and, 

25 ii) Present amiotations on the display in response to one or more input commands. 

The processing system can be adapted to store the annotations in accordance with an input 
command. 



30 The processing system may be coupled to a database, the processing system being adq>ted 
to store the amiotations in the database. The processing system can be coupled to the 
database via a communications network. 
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The processor and the store may be provided at a base station, the base station being 
coupled to one or more remote end stations via a conmnmications system, the input and the 
display being formed firom the end stations. 

5 The processing system is generally adapted to perform the method of the first broad form 
of the iavention. 

hi a third broad form the present invention provides a computer program product for 
allowing medical practitioners to demonstrate the effects of a medical condition, or a 
10 treatment to an individual, the computer program product including computer executable 
code which when executed on a suitable processing system causing the processing system 
to perform the method of the first broad form of the invention. 

In a fourth broad fix)m, the present invention provides apparatus for handling medical 
15 records, the records including a representation of a medical condition or treatment to be 
applied to an individual, the apparatus including: 

a) A database; and, 

b) A processor coupled to the database, the processor being adapted to: 
i) Determine the medical records; and, 

20 ii) Store the medical records in the database. 

The processing system can be coupled to one or more end stations via a communications 
network, the processor being adapted to: 

a) Receive a medical record request firom the end station; and, 
25 b) Transfer a selected medical record to the end station in accordance with the request. 

The request can include an indication of the medical practitioner making the request, in 
which case the processor can be adapted to: 

a) Compare the practitioner indication to practitioner data stored in a store, the 
30 practitioner data indicating authorisations for the viewing of medical records; 

b) Detemiine if the medical practitioner is authorised to view the selected medical 
record; and 

c) Transferring the medical record in accordance with a successful detemiination. 
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In this case, the medical records typically include an image together with one or more 
associated annotations, the medical record being generated in accordance with the methods 
of the first broad form of the invention. 

5 

Typically the processing system forms part of a processing system according to the second 
broad form of the invention. 

The database can be coupled to one or more processing systems by a commxmications 
10 network, thereby allowing the selected medical practitioners to access the patients medical 
records via the database using the processing systems. 

The processing systems are typically processing systems according to the first broad form 
of the invention. 

15 

Brief Description of the Drawings 

An example of the present invention will now be described with reference to the 
accompanying drawings, in which: - 

20 Figure 1 is a schematic diagram of an example of a system for implementing the present 
invention; 

Figure 2 is a flow chart outlining the process implemented by the processing system of 
Figure 1; 

Figures 3 A, 3B and 3C are a flow chart detailing the process of Figure 2; 
25 Figure 4A is an example of a menu generated by the processing system of Figure 1 
showing a number of different body systems; 

Figure 4B is an example of a menu outlining images, movies and stories that are available; 
Figure 4C is an example of annotation provided on a respective image by the processing 
system of Figure 1; 

30 Figure 5 is a schematic diagram of a second example of a system for implementing the 
present invention; and. 

Figure 6 is a schematic diagram of one of the end stations of Figure 5. 
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Detailed Description of fhe Preferred Embodiments 

An example of the present invention will now be described with reference to Figures 1 and 
2. In this example, a processing system is used to present one or more images to a patient 
to allow a medical practitioner, such as a Doctor or the like, to describe the effects of a 
5 medical condition or treatment 

An example of a processing system suitable for performing the present mvention is shown 
in Figure L 

10 In particular, the processing system 10 generally includes at least a processor 20, a 
memory 21, and an input device 22, such as a keyboard, an output device 23, such as a 
display, coupled together via a bus 24 as shown. An optional external interfece 25 may 
also be provided, as will be explained in more detail below. 

15 In use, the processor 20 is adapted to present one or more images in accordance with image 
data stored in the memory 21, or a remote database 1 1, coupled to the external interface 25, 
as shown by the dotted lines. In use, presentation of the images is usually controlled in 
accordance with input commands provided by the user, which may also be used to allow 
the xiser to aimotate one or more images. In general, the input commands are received 

20 either via the input device, or the external interface, with tihe images being presented on the 
output device, or being transferred to an external display means, via the external interface 
25. 

Accordingly, it will -be appreciated that the processing system may be any form of 
25 processing system suitably programmed to perform the analysis, as will be described in 
more detail below. The processing system may therefore be a suitably programmed 
computer, laptop, pahn computer, network or web server, or the like. Alternatively, 
specialised hardware or the like may be used. 

30 In any event, an example of the operation of the processing system 10 in displaying images 
will now be described in overview with reference to Figure 2. 



As shown at step 100 the first stage is for the medical practitioner to select an image 
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image sequence to be displayed to an individual, such as a patient. This is achieved to 
allow the medical practitioner to describe the effects of a medical condition or a treatment. 

* 

Thus for example, if the medical practitioner wishes to demonstrate the operation of a 
5 respective system in the body, the medical practitioner can select an appropriate image or 
sequence of images to be displayed. 

In general, each individual image corresponds to an image of a respective portion of the 
body shown in detail, for example in cross section, or the like. In the case of image 
10 sequences, each image sequence is usually a respective animation showing a respective 
potion of the body in operation. 

The images or image sequences include images of healthy bodies in normal operation, 
bodies suffering from a medical condition, or bodies undergoing treatment. This aids the 
15 medical practitioner in explaining the effects of medical conditions, treatments and general 
body operation to patients. 

The images and image sequences are generated using wire frame models, as described for 
example in WOOl/08076. Accordingly generation of the images and image sequences will 
20 not be described in fiirther detail. 

Once the image or image sequence has been selected, the processing system operates to 
display the image or image sequence at step 110. 

25 At step 120 the medical practitioner detemiines that an annotation to the image or image 
sequence is required. This may be used, for example, to highlight an area of interest to the 
respective patient, or to show the effect of the medical condition or treatment as this 
applies specificaUy to the individual. This may be required to help a patient remember 
details of the medical practitioners explanation, or the like, as will be described in more 

30 detail below. 

At step 130, the medical practitioner annotates the currentiy displayed image. This may be 
perfomied once a respective image has been displayed or alternatively, partway through 



wo 2004/034324 



8 



PCT/AU2003/001325 



the display of an image sequence. In the latter case, the display of the image sequence is 
generally halted at the image currently heing displayed. 

At step 140, the medical practitioner can cause the processing system to display the 
5 annotated image to the patient allowing flie doctor to explain particular aspects of a 
medical condition or treatment This aids significantly in the patient's understanding of 
their condition or the treatment that is to he given to the patient The annotated image may 
be provided to the patient m either a hard copy, presented on a display, or transferred to the 
patient electronically, via e-mail or the like. 

10 

In any event, at step 150 the annotated image may then optionally be stored in a store, 
allowiug the medical practitioner to keep a record of the annotations that were shown to 
the patient 

15 This process will now be described in more detail with respect to Figures 3 A to 3C. 

In particular, at step 200, the processing system 10 displays a menu of available image and 
image sequences to the medical practitioner. This may be achieved in a variety of ways 
depending on the specific implementation of the present invention. 

20 

Thus, for example, the processing system 10 can display a list of various medical 
conditions or treatments, allowing the medical practitioner to select the condition or 
treatment that is relevant to the patient. Alternatively, the processing system 10 can 
display a Ust of different body systems, such as the circulatory system, the nerve system, or 
25 the Uke. 

At step 210 the medical practitioner selects a desired image or image sequence fi-om the 
menu, and provides an indication of the selection to the processing system at step 220. 

30 An example of the manner in which this is achieved is shown in Figures 4. As shown in 
Figure 4A, the medical practitioner is initially presented with a number of images or text 
boxes, 40, 41, 42, . . . 50, each of which corresponds to a different body system. Jn general, 
the Ust will include details of at least one or more of the following systems: 
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• Cardiovascular; 

• Gastrointestinal; 

• Musculoskeletal; 

• Endocrine; 
5 • Lymphatic; 

• Nervous; 

• Reproductive; 

• Respiratory; 

• Sensory; 

10 • Urinary; and, 

• Skin. 

The medical practitioner selects an appropriate body system by positioning a cursor over 
the body system, which in turn causes additional detail of the body system to be displayed. 
15 Thus, for example, the medical condition may be a circulatory problem such as tbe build 
up of cholesterol. In this case, the medical practitioner selects the cardiovascular system 
40 from the list of different body systems shown in Figure 4A. 

The processing system will then display an image or menu of the respective system, 
20 together with details of the respective medical treatments and conditions for which images 
are available. 

Thus, in the case of the cardiovascular system, a representation of the cardiovascular 
system could be displayed. Alternatively, as shown in Figure 4B, a menu can be 
25 displayed, with the menu Usting various images 51, movies 52, or stories 53 of the 
different medical conditions and treatments that are available. 

In this regard stories are used to explain the effects of a condition through a series of 
images and text. 

30 

In this case, the medical practitioner then selects a cholesterol build up example, such as 
peripheral vascular disease, again by placing the cursor over the respective mdication, and 
making an appropriate selection. 
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It will be appreciated by those skilled in the art, fliat each indication may in turn include 
sub-indications, allowing further different categorisation of the images or image sequences 
to be displayed. Thus, for example, each indication could correspond to a respective 
5 portion of the displayed system, with the sub-indications corresponding to the effect of the 
medical condition and the effect of the treatment respectively. 

Thus, for example, a first sub-indication could correspond to a sequence of images 
showing the operation of the circulatory system with cholesterol build up in place, with a 
10 second sub-indication showing the operation of a healthy circulatory system, progressing 
through an animation showing the build up of cholesterol within the circulatory system, 
together with the subsequent effect on the operation caused by the cholesterol build up. 

Conversely, in the case of a treatment the image sequence could simply show the 
15 improvement in the operation of the circulatory systems as medication, or improved diet 
are used to treat the condition. 

In order to achieve this, the processing system 10 accesses image data stored in the store at 
step 230, in accordance with the hnage or image sequence selected by the medical 
20 practitioner at 220. The image data corresponds to an image or image sequence, which is 
typically generated usmg a wire firame model, as described for example in WOO 1/08076. 

In^this example, the store may comprise the memory 21 or a database, or the like, 
connected to the processing system via the external interface 25, or a CD-ROM, DVD, or 
25 other storage media. 

In any event, at step 240 the processing system 10 displays the selected image or one or 
more images firom the selected image sequence. Thus, if a medical practitioner selects an 
option corresponding to an image sequence, the processing will begin to display the image 
30 sequence in the form of an animation. 

At step 250 the medical practitioner determines that annotation of the image or image 
sequence is required. This wiU typically occur whilst the medical practitioner is explaining 
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the condition and or treatment to the pati^t. 

Thus for example, it may become evident that the patient does not fully comprehend a 
certain aspect of the medical condition or treatment the medical practitioner is e3q)laining. 
5 Accordingly, in this instance the medical practitioner can help by providmg annotations on 
an image to help explain a point In the event that the medical practitioner detennines an 
aimotation as required at step 250, the medical practitioner provides an indication that 
aimotation is required at step 260. 

10 This is typically achieved by selecting an annotation tool from an annotation tool menu 
displayed by the processing system 10, as shown for example at 60 in Figure 4C. It will be 
noted tiiat Figure 4C is presented as a negative image to help improve the contiast of the 
annotations for the purpose of presentation herein only. 

15 It will be appreciated, that an iiq)ut command from the medical practitioner may be 
required to display the animation tool menu. The animation tools typically include tools 
such as: 

• Text annotations; 

• Drawing annotations including shapes, lines or free-handed drawings; 
20 • Verbal annotations; 

• Link amiotations, to provide links to other information, such as hyperlinks to websites; 

Having selected an annotation tool to thereby indicate that annotation is required at step 
260, the processing system 10 determines if an image sequence is being displayed at step 
25 270. If an image sequence is being displayed at step 280, the processing system 10 halts 
the image sequence and displays only the current image in the sequence at step 290. 

Once a single static image is being displayed at step 300, tiie medical practitioner provides 
an indication of the desired annotation to the processing sj^tem 10. Thus, for example, if 
30 the medical practitioner has selected a text insert tool, the medical practitioner will be 
provided with a cursor that can be positioned on the image allowing the medical 
practitioner to input text which is then displayed superimposed on the image at tiie location 
of the cursor, at step 310. This is shown for example at 61 in Figure 4C. 



wo 2004/034324 



12 



PCT/AU2003/001325 



Alternatively, the medical practitioner tnay select a drawing tool, such as one used in 
drawing software appUcations. Again, the doctor will control the drawing tool to draw 
shapes or Unes on the image at step 300 with the annotation being displayed at step 310. 
5 This is shown for example at 62 in Figure 4C. 

Other annotation tools can also be used as described above. Thus, in the case of verbal 
annotations, the medical practitioner will be able to record the provided explanation 
associated with a respective portion of the image. This allows the patient to replay the 
10 medical practitioner's explanation, for example by selectmg a highlighted area of an 
electronic version of the image, which includes the record voice data associated therewith. 

Similarly, in the case of link annotations, the medical practitioner may provide a link such 
as a hyperlink, or the like, which directs tiie user to a web site or the like which includes 
15 additional information relating to the condition and or treatment, or even further 
animations explaining the process in further detail. 

It will be appreciated that in the cases of link and verbal annotations, it may only be 
possible for the patient to activate the amotations if the patient has an electronic copy of 
20 the annotated image, including the required data, as will be described in more detail below. 

In any event, the medical practitioner explains the medical condition or treatment to the 
patient in accordance with the displayed annotation at 320. It will be appreciated that 
although this has been shown as a subsequent step, usually steps 300 and 310 are 
25 performed simultaneously at step 320 such that the medical practitioner explains the 
medical condition whilst providing the annotations. 

At step 330 the medical practitioner determines if further amotations are required. Thus, 
this may occur if the patient still does not understand the process or if dififerent types of 
30 annotation are required. 

If further annotations are required, the medical practitioner will typically select a 
respective annotation tool, allowing the processing systOTi to detemiine that further 
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annotation is reqxiired at step 340. Accordingly, the process returns to step 300 where the 
medical practitioner again provides an indication of the desired annotation to the 
processing system 10, 

5 Thus, it will be appreciated that the medical practitioner may first draw a nimiber of lines 
on the image to highlight selected areas of the image at steps 300 to 310. Whilst 
performing this, the medical practitioner may explain various aspects of the conditional 
treatment to ttie patient, who then indicates that he will not remember this information. 

10 Accordingly, at step 340, the medical practitioner selects the text annotation tool, 
indicating that further annotation is required. Accordingly, the process returns to step 300 
allowing the medical practitioner to provide a text description that will act as a reminder to 
the patient. 

15 Once it is determined that further annotations are not required, at step 340, then at step 
350, the medical practitioner determines if the annotated image is to be output. 

Thus, if the medical practitioner detemiines that the annotated image is to be output at step 
360 the medical practitioner provides an indication of the output form to the processing 
20 system 10 at step 370, allowing the processing system 10 to output the annotated image at 
step 380. 

Thxis for example, the image may be printed and handed to the patient to be taken away. 
In this case, the medical practitioner may print a second copy of the document to be kept in 
25 the patient's medical records. 

Alternatively, the annotated image may be output m electronic format, such as via e-mail, 
or on a transportable media, such as a floppy disc, CD-ROM, or the like, to allow the 
patient access to an electronic version of the annotated image. It will be appreciated that 
30 this is particularly useful in the event that the annotation is in the form of links such as 
hyperlinks to other electronic information, or if vocal annotations are provided. 



Alternatively, if the annotated image is only used for the purpose of demonstration during 
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the medical practitioner's e?q)lanation, it may be preferred not to output the image at all. 

Once the annotated image is output, or if no annotated image is to be output, the medical 
practitioner determines if the annotated image is to be stored at step 390. This may be 
5 performed to allow the medical practitioner to store an indication of the annotations 
provided to the patient, or the like. 

This could be particularly useful for use in patient records, or the like. This is particularly 
important in view of recent litigation in the medical industry that has resulted in medical 
10 practitioners being questioned regarding advice given to patients sometimes years after the 
advice was provided. 

This also allows the medical practitioner to retain visual representations of the patient's 
condition on the various occasions when tiie medical practitioner has seen the patient. 
15 Thus for example, the medical practitioner may provide annotations indicating the patient's 
current health status, thereby allowing the annotated images to form the patient's medical 
notes. 

Accordingly, if the annotated image is to be stored at step 400 the medical practitioner 
20 provides an indication to store the image to the processing system 10 at step 410. The 
processing system 10 stores the annotated image in a store at step 420. 

Again, this may be achieved by storing the annotated image in the memory 21 or in a 
remote database coupled to the processing system via the extemal interface 25. Thus, for 

25 example, the medical practitioner may wish to store the annotated image in a store, such as 
a database, provided at the medical practitioners office. Altematively, the storage may 
occur for example by placing flie records on a physical media, such as a floppy disc, CD- 
ROM, or the like, which is then stored together with the patient^s records, which may for 
example be stored as a paper file. Additionally, as will be described in more detail below, 

30 the document may be stored in a remote database, such as at a central location. In any 
event, it will be typical for the medical practitioner to provide an indication of the storage 
location at step 410. 
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At step 430 the process ends allowing the medical practitioner to select an alternative 
image or image sequence to be displayed either to the current patient or a subsequent 
patient 

5 It will be ^reciated that the abovementioned process can be implemented using a variety 
of architectures. Thus, in the example described above Ihe processing system 10 is used 
directly by the medical practitioner. This will therefore typically consist of a computer 
system, such as a phonal computer, handheld PDA, laptop, or the like provided at the 
medical practitioner's office, such as at a doctor's surgery in the case of a medical 
1 0 practitioner being a GP. 

In this case, the appUcations software and image data may be provided in the memory 21 
to allow the abovementioned process to be performed. It will be appreciated that this is 
particularly useful for medical practitioners in demonstrating the effects of medical 

15 conditions and treatments on a day to day basis. For example, in a hospital environment. 
Doctors can be provided with handheld computers including a software appUcation 
mstalled thereon for providing the required functionality. In this case, when the Doctor 
discusses a condition or treatment with a patient, this allows the Doctor to show the 
patient, with annotations, without requiring the patient to move to an appropriate terminal 

20 or other computer system. 

However, network based systems, such as web or intranet LAN based systems or the hke 
may also be implemented. An example of this is shown in Figure 5 in which the 
processing system 10 is coupled to a database 11, provided at a base station 1. The base 
25 station 1 is coiq>led to a number of end stations 3 via a communications network 2, such as 
the Internet, and/or via communications networks 4, such as local area networks (LANs) 4. 
Thus it will be appreciated that the LANs 4 may form an internal network at a doctor's 
surgery, hospital, or other medical institution. This allows the medical practitioners to be 
situated at locations remote to the central base station 1. 

30 

In this example, whilst a single base station 1 is shown, it will be appreciated that a number 
of base stations 1, or database 11 may be provided, such that a respective base station 1 
and/or database 1 1 may be provided associated with a LAN, such as a network in a 



wo 2004/034324 



-16- 



PCT/AU2003/001325 



hospital. In this case, the system may be adapted such that only end station 3 coupled to 
the respective LAN 4 are capable of accessing the respective base station 1 or database 1 1 . 

In any event, in use the end stations 3 must be adapted to communicate with the processing 
5 system 10 positioned at the base station 1, and the manner in which this is achieved will 
depend on the respective unplementation. It will be appreciated that this allows a number 
of different forms of end station 3 may be used. 

An example of a suitable end station is shown in Figure 6, As shown the end station 3 
1 0 includes a processor 30, a memory 3 1 and an input device 32 such as a keyboard, an output 
device 33 such as a display coupled together via a bus 34, as shown. An mtemal interface 
35 is typically provided to aUow the end station to be coupled to one of the 
commimications networks 2, 4. 

15 Accordmgly, the end station 3 may be a computer, laptop, handheld computer such as a 
PDA, or the Uke. However, alternatively the device may be specialised hardware, or the 
like. 

In use, the processor 30 is adapted to communicate with the processing system 10 provided 
20 in the base station 1 via the communications networks 2, 4 to allow the above described 
process to be inq)lemented. Accordingly, it will be appreciated that if the communications 
network 2 is the Internet, this wiU typically be achieved by having the base station 1 
present web pages to the medical practitioner on the end station 3. The medical 
practitioner can then navigate the web pages, such as through the use of hyperlinks thereby 
25 allowing the images to be selected and displayed. Similarly, annotation can be performed 
in a similar way. 

In this mstance it will be appreciated that the image data can be stored centraUy at the 
database 1 1 allowing it to be transferred to the medical practitioner as required. Thus, in 
30 the case in which the end station 3 is a handheld device, this can be coupled to a central 
image store, such as the database 1 1 (which may be provided locally on the LAN 4), so 
tiiat unages can be downloaded to the device as required. This may be achieved via either 
•wired or wireless connections, as will be appreciated by persons skilled in the art In any 
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event, this overcomes the need to store large amounts of image data on devices having 
limited memory capeicity. 

However, in some cases the quantity of the image data may be difficult to transmit over the 
5 network, such as the Internet in real time. Accordingly, the image data and information 
application software can alternatively be provided locally to each respective end station 3, 
This may be achieved by providing databases 11 locally to the end stations 3, for example 
on the communications networks 4, as shown. Alternatively, the image data could be 
stored in the memory 21 of each end station ?, or downloaded as required, for example 
10 from a CD-ROM, or the Hke. 

When the medical practitioner is to store the annotated image, the annotated image can be 
transferred via the communications networks 2, 4 to a base station 1 for storage in flie 
database 1 1. Accordingly, it will be appreciated that in this later example the base station 

15 1 is simply used to centrally store the annotated images, with the end stations 3 operating 
as the processing system described in Figure 1. From this it will be appreciated that the 
end stations 3 may provide equivalent functionality to the processing system 10 described 
in Figure 1, by having the processor 30 execute appropriate applications software, which 
may be stored in the memory 3 1 , or accessed from an external source, such as a CD-ROM, 

20 DVD, or the like. 

In any event, regardless of whether the image data is stored centrally at the base station 1, 
or locally at the end stations 3, the architecture shown in Figure 5 allows the end stations 3 
to store the annotated images at a central location. This has a number of benefits. 

25 

In particular, this allows ^different medical practitioners to share information. Thus for 
example, if a patient moves from one GP to another GP, the new GP could access any 
patient's medical records that are stored at the database 1. 

30 Alternatively, the annotated images and/or medical records may be stored at the database 
1 1 for subsequent reference in legal actions. This is particularly useful as the provision of 
a centrally stored image could avoid subsequent manipulation of the image by the medical 
practitioners, thereby helping ensure the accuracy of infomiation tiiat may be supplied in a 
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Court action. Accordingly, in this instance the base station 1 may be provided at an 
insurance company, a professional medical body, or the like, for use in subsequent legal 
disputes. 

5 Furthermore, the central storage of annotated images may be used as a back-up, to thereby 
ensure that copies of the annotated images are not lost, for example due to failure of the 
medical practitioners storage systems. 

In ttie event that annotated images are to be viewed by the users of the end stations 3, it is 
10 important that access to the aimotated images is only provided to authorised users. In 
particular, it is generally imdesirable for third parties to be able to obtain copies of 
individual's medical records, as these might be used for undesirable purposes. 

Accordingly, the processing system 10 typically maintains a list of medical practitioner 
1 5 identifiers, together with an indication of the aimotated images they are entitled to view. 

Thus, medical practitioners may be limited to only viewing annotated images they have 
created and/or submitted. Alternatively, if a patient moves between GP, then permission to 
view the annotated images may be removed fix>m one GP and transferred to another GP. 

20 

It will be appreciated that when the medical practitioners need to view an annotated image 
stored in the database 11, the medical practitioner will typically have to provide an 
indication of ttieir respective identifier to the base station 1. The base station 1 will then 
validate the identifier, for example, through the use of a password system, biometric data, 
25 or the like, as will be q)preciated by persons skilled in the art. This is performed to 
confirm that the user supplying the identifier is the medical practitioner to whom the 
identifier has been assigned. 

This allows the base station 1 to determine the annotated images the respective medical 
30 practitioner is entitled to view. The medical practitioner can then select the required 
annotated image, which will then be transferred to the end station 1, for subsequent 
display. The annotated image can then also be output firom the end station 3, in a manner 
similar to that described above with respect to Figure 3C. 
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Thus, it will be appreciated that the above described network configuration, which is for 
the purpose of example only and is not intended to be limiting, may be used to allow image 
data to be retrieved from a central repository, such as the database 1 1, to allow image data 
5 representing aimotated images to be stored centrally in a repository, or a combination of 
either of these modes of operation. 

Variations 

A number of additional developments can also be incorporated into the process outlined 
10 above. 

Thus, for example, the annotated images may be provided with a tune and date stamp, that 
indicates the time and date on which the annotations were created. This can be achieved 
by havmg the processing system 10, or the end station 3 encoded an indication of the time 
15 and date of the annotations within the image before it is stored. This time and/or date 
stamp can be encrypted using a predetermined encryption algoritimi, tiiereby preventing 
the subsequent alteration of the time and/or date stamp. 

The annotated images are typically marked with predetermined information, including the 
20 time and date at which the annotations are made, the name of tiie patient (or an appropriate 
patient ideatifier if confidentiality is an issue, as described below), and the name of the 
demonstrating medical practitioner. Additionally, or alternatively, other information may 
also be provided, such as the patient's medical record number, medicare number, >JHS 
number, or private health insurance scheme reference number. 

25 

This information can be used for reference purposes," for example as evidence of a 
consultation, the information provided to the patient therein, and the medical practitioner 
that provided the advice. It will be appreciated Ibat tiiis is of significant use in monitoring 
medical practitioners and is also usefiil for any subsequent legal claims that may occur. 

■ 30 

When the annotated images are stored, this can be achieved in a number of ways. Thus, 
for example, it is possible to form new image data representing the image and the 
superimposed annotations, with the new image data being stored. 
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Altesmatively, it is possible to store data representing the annotations made, together with 
an indication of the image to which the annotations were applied. Thus, for example, in 
this latter case, as the image data is akeady stored, the annotations can be stored as 
5 annotation data, including a cross Reference to the image data. When the annotated image 
is to be viewed in due course, the annotation data can be retrieved by either the processing 
system 10, or the end station 3, which then determine the respective image data from the 
indication stored in the annotation data. This aUows the annotated image to be 
reconstructed from the annotation and image data. It will be appreciated that this will 
10 reduce storage requirements for the annotated images. 

It will be appreciated that if the annotated images, and/or medical records are stored 
centrally in a database 11, there are issues surrounding the security of the, data. In 
particular, it will be undesirable for the information to be accessed by third parties, which 
1 5 may allow the information to be used unlawfiilly. 

Accordingly, the annotated images may be stored in an encrypted format. This can be 
achieved by having encryption performed by either the processing system 10, or the end 
station 3, depending on the respective implementation of the invention. ' Thus, for 
20 example, each medical practitioner may encrypt any annotated images they create using a 
respective encryption algorithm. This can be used to ensure that only the medical 
practitioner creating an annotated image can view the annotated image. 

Additionally or alternatively, the annotated images can be encrypted centrally. This can be 
25 used to help ensure that the annotated images cannot be unlawfully viewed by third parties. 
In this case, when the annotated images are to be retrieved by a medical practitioner, the 
annotated image may be decrypted either before or after bemg transferred to the medical 
practitioner's end station 3. 

30 Furthermore, the annotated images may be stored m the database associated with a patient 
identifier representative of the respective patient. The identifier may be in any suitable 
form, such as a alphanumeric code, and may be based on existing patient information, such 
as the patient name, medicare number, NHS number, or the like. Thus, for example, the 
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identifier can be generated fix>m patient information using a predetermined algorithm, or 
the like. By using a one way algorithm, this allows the patient identifier to be determined 
ftom patient details, but not for the patient details to be determined from a patient 
identifier. 



A mapping between a respective patient identifier and the corresponding patient can be 
stored in an alternative location, such as on the medical practitioner's end station 3. This 
may be achieved through the use of a look-iq) table including an indication of the patient 
name for each identifier, or alternatively may be achieved be storing details of the 
1 0 algorithm used to generate the identifier. 

In this instance, even if unlawfia access to the database 1 1 were obtained, then any third 
parties would be unable to determine the patient to which each annotated image referred 
without also obtaining details of the mapping of the patient identifier to the patient. As this 
is typicaUy stored in a different location, such as at a Doctor's office, hospital, or the Uke, 
and is not generally provided at the same location as the central storage faciUty, this 
increases the difficulty for third parties attempting to determine to whom a record belongs. 
In particular, the third party would typically require access to both the central repository 
and the mapping. Furthermore, if the m^ing were not stored in electronic format, this 
20 would finlher hamper the abiUty of any third party to determine which annotated unage 
corresponds to which patient. 



25 



Persons skilled in the art will appreciate that numerous variations and modifications will 
become apparent. All such variations and modifications that become apparent to persons 
skilled in the art should be considered to faU within the spirit and scope that the invention 
broadly appearing before described. 



